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We present a method of solving of the probabilistic initial value problem for cellular automata (CA) using CA rule 
172 as an example. For a disordered initial condition on an infinite lattice, we derive exact expressions for the 
i i density of ones at arbitrary time step. In order to do this, we analyze topological structure of preimage trees of 

finite strings of length 3. Level sets of these trees can be enumerated directly using classical combinatorial methods, 
yielding expressions for the number of n-step preimages of all strings of length 3, and, subsequently, probabilities of 
occurrence of these strings in a configuration obtained from the initial one after n iterations of rule 172. The density 
of ones can be expressed in terms of Fibonacci numbers, while expressions for probabilities of other strings involve 
Lucas numbers. Applicability of this method to other CA rules is briefly discussed. 
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<N 1 Introduction 

o 

While working on a certain problem in complexity engineering, that is, trying to construct a cellular au- 
r — tomaton rule performing some useful computational task, the author encountered the following question. 

O Let / : {0, 1} 3 -> {0, 1} be defined as 



, x 2 if Xi =0, 
f(x 1 ,x 2 ,x 3 ) = i ^ . fxi = h (1) 



This function may be called selective copier, since it returns (copies) one of its inputs x 2 or xy, depending 
on the state of the first input variable x\. Suppose now that s be a bi-infinite sequence of binary symbols, 
i.e., s = . . . s_2 s -i s o s i s 2 ■ ■ ■, i € TL. We will transform this string using the selective copier, that is, 
for each i, we keep Sj if it is preceded by 0, or replace it by Sj+i otherwise, so that each Sj is simulta- 
neously replaced by /(sj_i, Sj, Sj+i). Consider now the question: Assuming that the initial sequence is 
randomly generated, what is the proportion of 1 's in the sequence after n iterations of the aforementioned 
procedure? 

^The author acknowledges partial financial support from Natural Sciences and Engineering Research Counclil of Canada, in the 
form of a Discovery Grant. 
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Function defined by eq. dTb is a local function of cellular automaton rule 172, using Wolfram number- 
ing, and the aforementioned question is an example of a broader class of problems, which could be called 
probabilistic initial value problems for cellular automata: given initial distribution of infinite configura- 
tions, what is the probability of occurrence of a given finite string in a configuration obtained from the 
initial one by n iterations of the cellular automaton rule? In what follows, we will demonstrate how one 
can approach probabilistic initial value problem using cellular automaton rule 172 as an example. 

2 Basic definitions 

Let Q = {0, 1, ...AT— 1} be called a symbol set, and let S(Q) be the set of all bisequences over Q, where by 
a bisequence we mean a function on 7L to Q. Set S(Q) will be called the configuration space. Throughout 
the remainder of this text we shall assume that Q — {0, 1}, and the configuration space S(Q) — {0, 1} Z 
will be simply denoted by S. 

A block of length n is an ordered set bobi . . . 6 n _i, where n £ N, bi £ Q. Let n £ N and let B n denote 
the set of all blocks of length n over Q and B be the set of all finite blocks over Q. 

For r £ N, a mapping / : {0, l} 2r+1 h> {0, 1} will be called a cellular automaton rule of radius r. 
Alternatively, the function / can be considered as a mapping of $27+1 into Bq = Q = {0, 1}. 

Corresponding to / (also called a local mapping) we define a global mapping F : S — >• S such that 
(F(s))i = f(si- r , ...,Si,..., s l+r ) for any s £S. 

A block evolution operator corresponding to / is a mapping f : B H> B defined as follows. Let r £ IN 
be the radius of /, and let a = a^a\ . . . a„_i £ B n where n > 2r + 1 > 0. Then 

f ( a ) = {/(Oi:0»+l) • • • ! a i +2r)}™=o 2r_1 - ( 2 ) 

Note that if b £ B 2r+l then f{b) = f (6). 

We will consider the case of Q — {0, 1} and r = 1 rules, i.e., elementary cellular automata. In this 
case, when b £ B 3 , then f(b) = f (6). The set B 3 = {000, 001, 010, 011, 100, 101, 101, 110, 111} will be 
called the set of basic blocks. 

The number of n-step preimages of the block b under the rule / is defined as the number of elements 
of the set f~ n (b). Given an elementary rule /, we will be especially interested in the number of n-step 
preimages of basic blocks under the rule /. 



3 Probabilistic initial value problem 



The appropriate mathematical description of an initial distribution of configurations is a probability mea- 
sure n on S. Such a measure can be formally constructed as follows. If b is a block of length k, i.e., 
b = bobi . . . bk-i, then for ieSwe define a cylinder set. The cylinder set is a set of all possible config- 
urations with fixed values at a finite number of sites. Intuitively, measure of the cylinder set given by the 
block b = bo . . . bk-i, denoted by fi[Ci(b)], is simply a probability of occurrence of the block bin a place 
starting at i. If the measure p, is shift-invariant, than fi(Ci(b)) is independent of i, and we will therefore 
drop the index i and simply write /i(C(6)). 

The Kolmogorov consistency theorem states that every probability measure p, satisfying the consistency 
condition 

fxidih . . . b k )} = nldQ,! . • . b k , 0)] + ulCiih . . . b k , 1)] (3) 
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extends to a shift invariant measure on S (Dynkin 1969|l .For p <E [0, 1], the Bernoulli measure defined 



as fj. p [C(b)] — pi(l — p) fc ~"' , where j is a number of ones in b and k — j is a number of zeros in b, is 
an example of such a shift-invariant (or spatially homogeneous) measure. It describes a set of random 
configurations with the probability p that a given site is in state 1, 

Since a cellular automaton rule with global function F maps a configuration in S to another configura- 
tion in S, we can define the action of F on measures on S. For all measurable subsets E of S we define 
(F/j,)(E) — ^l(F^ 1 (E)), where F^ 1 (E) is an inverse image of E under F. 

If the initial configuration was specified by fi p , what can be said about F n /j, p (i.e., what is the probability 
measure after n iterations of F)7 In particular, given a block b, what is the probability of the occurrence 
of this block in a configuration obtained from a random configuration after n iterations of a given rule? 

The general question of finding the iterrates of the Bernoulli measure under a given CA has been 



extensively studied in recent years by many authors, including, among others, Lind 
i; |Maass and Martinez] ( [2l)0"3] l; |Hostet al.| ( [2003] l; |Piva"to and Yassawr] ( p002 



(2000 



1984 



i;|Ferrari et al. 



2004 



i; IMaass et al. 



i and Maass et al. (2006). In this paper, we will approach the problem from somewhat different 



(2006 

angle, using very elementary methods and without resorting to advanced apparatus of ergodic theory and 

symbolic dynamics. We will consider iterates of the Bernoulli measure by analyzing patterns in preimage 

sets. 

For a given block b, the set of n-step preimages is f ~ n (b). Then, by the definition of the action of F on 
the initial measure, we have 

(F n n P )(C(b))=n P (F- n (C(b))), (4) 

and consequently 

(F> P )(C(6)) = £ Ma). (5) 

aef-^fc) 



Let us define the probability of occurrence of block 6 in a configuration obtained from the initial one by n 
iterations of the CA rule as 

P n {b) = {F n n p ){C{b)). (6) 

Using this notation, eq. (Bl) becomes 

aGf""(6) 

If the initial measure is /I1/2, then all blocks of a given length are equally probable, and Po(a) = J^, 
where \a\ is the length of the block a. For elementary CA rule, the length of n-step preimage of b is 
2n+ \b\, therefore 

P„(&) = 2-l fe l- 2n cardf- n (&). (8) 

This equation tells us that if the initial measure is symmetric (/I1/2), then all we need to know in order to 
compute P n (b) is the cardinality of f ~ n {b). One way to think about this is to draw a. preimage tree for b. 
We start form & as a root of the tree, and determine all its preimages. Then each of these preimages is 
connected with b by an edge. They constitute level 1 of the preimage tree. Then, for each block of level 1, 
we again compute its preimages and we link them with that block, thus obtaining level 2. Repeating this 
operation ad infinitum, we obtain a tree such as the one shown in Figure [T] In that figure, five levels of the 
preimage tree for rule 172 rooted at 101 are shown, with only first level labelled. 



Cellular automaton rule 172 



41 




Fig. 1: Preimage tree for rule 172 rooted at 101. 

Note that cardf~ n (fo) corresponds to the number of vertices in the n-th level of the preimage tree. 
One thus only needs to know cardinalities of level sets in order to use eq. d8), while the exact topology 
of connections between vertices of the preimage tree is unimportant. The key problem, therefore, is to 
enumerate level sets. In order to answer the question posed in the introduction, we need to compute P n (1) 
for rule 172, which, in turn, requires that we enumerate level sets of a preimage tree rooted at 1. It turns 
out that for rule 172 the preimage tree rooted at 1 is rather complicated, and that it is more convenient to 
consider preimage trees rooted at other blocks. In the next section, we will show how to express P n (l) by 
some other block probabilities. From now on, f will exclusively denote the block evolution operator for 
rule 172. 



4 Block probabilities 

Since f- x (l) = {010, Oil, 101, 111}, we have P„+i(l) = P„(010) + P n (011) + P„(101) + P„(lll) 
Due to consistency conditions (eq. 15), P„(010) + P„(011) = P„(01), and we obtain 



Pn+l(l) = Pn(01) + P„(101) + P„(lll). 



(9) 
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This can be transformed even further by noticing that P„ (01) = P„(001) + P„(101), therefore 

P„(l) = P„_i(001) + 2P n _ 1 (101) + P„-i(lll). (10) 

By using eq. <fsT> and defining c n — P n (l) we obtain 

cardf-"+ 1 (001) + 2cardf-"+ 1 (101)+cardf- ,l+1 (lll) 



22n+l 



(ID 



This means that in order to compute c„, we need to know cardinalities of n-step preimages of 001, 101, 
and 111. 

5 Structure of preimage sets 

The structure of level sets of preimage trees rooted at 001, 101, and 111 will be described in the following 
three propositions. 

Proposition 5.1 Block b belongs to f~™(001) if and only if it has the structure 

b = **... *001 *•...*, (12) 

n n 

where * represents arbitrary symbol from the set {0, 1}. 

Let us first observe that f- x (001) = {00010, 00011, 10010, 10011}, which means that f- x (001) can be 
represented as **001**. Similarly, therefore, f~ 2 (001) has the structure ***001***, and by induction, 
for any n, the structure of f ~ n (001) must be **...* 001 * * ... *. □ 

n n 

Proposition 5.2 Block b belongs to f~"(101) if and only if it has the structure 

b = ••...•o 1 a 2 ...a n 1101, (13) 



where di £ {0,l}/ori = 1, ... ,n and the string a\a2 ... a n does not contain any pair of adjacent zeros, 
that is. a^ai+i ^ 00 for all i = 1, . . . , n — 1. 

Two observations will be crucial for the proof. First of all, f-^lOl) = {01101, 11101}, thus f-^lOl) 
has the structure *1101. Furthermore, we have f _1 (1101) = {011101, 101101, 111101}, meaning that if 
1101 appears in a configuration, and is not preceded by 00, then after application of the rule 172, 1101 
will still appear, but shifted one position to the left. All this means that if b is to be an n-step preimage of 
101, it must end with 1101. After each application of rule 172 to b, the block 1101 will remain at the end 
as long as it is not preceded by two zeros. 

Now, let us note that f-^OO) = {0000, 0001, 1000, 1001, 1100}, which means that preimage of 00 is 
either 1100 or *00*. Therefore, we can say that if 00 is not present in the string a\a2 ■ ■ ■ a n , it will not 
appear in its consecutive images under f. Thus, block 1101 will, after each iteration of /, remain at the 
end, and will never be preceded by two zeros. Eventually, after n iterations, it will produce 101, as shown 
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in the example below. 
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What is left to show is that not having 00 in aiCfc • • - a n is necessary. This is a consequence of the fact 
that f (*00*) = 00, which means that if 00 appears in a string, then it stays in the same position after 
the rule 172 is applied. Indeed, if we had a pair of adjacent zeros in a\a 2 . . . a n , it would stay in the 
same position when f is applied, and sooner or later block 1101, which is moving to the left, would come 
to the position immediately following this pair, and would be destroyed in the next iteration, thus never 
producing 101. Such a process is illustrated below, where after three iterations the block 1101 is destroyed 
due to "collision" with 00. □ 
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Proposition 5.3 Block b belongs to f n (lll) if and only if it has the structure 

(14) 

where a>i € {0, l}for i = 1, . . . , n and the string a\a 2 ■ ■ ■ a n satisfies the following three conditions: 

(i) ai(ii + i 7^ 00 for all % = 2 . . . n 4- 4; 

(ii) a n+3 a n+i a n+5 ^ 110 and a n+2 a n+3 a n+4 ^ 110; 

(Hi) ifa x a 2 ^ 00, then a n+ ia n+2 a n+3 ^ HO. 

We will present only the main idea of the proof here, omitting some tedious details. It will be helpful to 
inspect spatiotemporal pattern generated by rule 172 first, as shown in Figure [2] Careful inspection of this 
pattern reveals three facts, each of them easily provable in a rigorous way: 

(Fl) A cluster of two or more zeros keeps its right boundary in the same place for ever. 

(F2) A cluster of two or more zeros extends its left boundary to the left one unit per time step as long as 
the left boundary is preceded by two or more ones. If the left boundary it is preceded by 01, it stays 
in the same place. 

(F3) Isolated zero moves to the left one step at a time as long as it has at least two ones on the left. If an 
isolated zero is preceded by 10, it disappears in the next time step. 
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v =11 Hi 1 1 niiiHp :r ..p i roffl lllii in iiiIHIiii liisisiiiiiSiiiiEiii 



Fig. 2: Example of a spatiotemporal pattern produced by rule 172. 

Let us first prove that (i)-(iii) are necessary. Condition (i) is needed because if we had 00 in the string 
a 2 . . . a„+ 5 , its left boundary would grow to the left and after n iterations it would reach sites in which 
we expect to find the resulting string 111. 

Moreover, string a\a,2 ■ ■ ■ a n +5 cannot have Oil at the end position, one site before the end, or two sites 
before the end. If it had, preceded by two 1 's would move to the left and, after n iterations, it would 
reach sites where we want to find 111. The only exception to this is the case when a^a\ = 00. In this 
case, even if Oil is in the second position from the end, it will disappear in step n — 1. This demonstrates 
that (ii) and (iii) are necessary. 

In order to prove sufficiency of (i)-(iii), let us suppose that the string b satisfies all these conditions 
yet f"(6) ^ 111. This would imply that at least one of the symbols of i n (b) is equal to zero. However, 
according to what we stated in F1-F3, zero can appear in a later configuration only as a result of growth 
of an initial cluster of two of more zeros, or by moving to the left if it is preceded by two ones. This, 
however, is impossible due to conditions (i)-(iii). □. 



6 Enumeration of preimage strings 



Once we know the structure of preimage sets, we can enumerate them. For this, the following lemma will 
be useful. 

Lemma 6.1 The number of binary strings a\a,2 ■ ■ ■ a n such that 00 does not appear as two consecutive 
terms 0,^+1 is equal to F n+2 , where F n is the n-th Fibonacci number. 

This result will be derived using classical transfer-matrix method. Let g(n) be the number of binary 
strings 0,10,2 ■ ■ ■ a n such that 00 does not appear as two consecutive terms OjOj+i. We can think of such 
string as a walk of length n on a graph with vertices vi — and v 2 = 1 which has adjacency matrix A 
given by An = 0, A12 = A21 = A22 = 1- One can prove that the generating function for g, 



G(\) = J2g(n+l)Y 



(15) 
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can be expressed by G(X) = Gn(A) + Gi2(A) + G*2i(A) + G22W, where 

(-l) l+ idct(I - XA: j,i) 



G, 



det(J - XA) 



45 



(16) 



and where (M : j, i) denotes the matrix obtained by removing the j — th row and i — th column of M. 
Proof of this statement can be found, for example, in Stanley]( fl986 1. Applying this to the problem at hand 
we obtain 

G(X)- ^ 2 + A ) 



-1 + A + A 2 ' 
By decomposing the above generating function into simple fractions we get 



G(X) 



in 



ro^ 



X + tp 



X + I-i/j ' 



where ip = i + hV5 is the golden ratio. Now, by using the fact that 



1 



E 



1 



n+l 



and by using a similar expression for A+ ^_ , , we obtain 

V> n - (1 - V')" 



(17) 



(18) 



(19) 



G(A) = ^F n+3 . 

n=0 



(20) 



where F n is the 71-th Fibonacci number, F n = 



V5 



This implies that 5(71) = i 7 ' n +2- n 



Proposition 6.1 77;e cardinalities of preimage sets of 001, 100, 101 and 111 are given by 

caxdf-"(001) = 4™, 



cardf- n (101) 
cardf _n (lll) 



2"- 1 F, 



n+2, 



2"F, 



n+3- 



(21) 

(22) 
(23) 



Proof of the first of these formulae is a straightforward consequence of Proposition |5.1| We have In 
arbitrary binary symbols in the string b, thus the number of such strings must be 2 2n = 4™. 



The second formula can be immediately obtained using Lemma 6.1 and Proposition 5.1 Since the 
first ?i—l symbols of f _n (101) are arbitrary, and the remaining symbols form a sequence of n symbols 
without 00, we obtain 



cardf-"(101) = 2 n - 1 F n+2 - 



(24) 



In order to prove the third formula, we will use Proposition 5.3 We need to compute the number 
of binary strings 0,10,2 ■ ■ ■ a n +5 satisfying conditions (i)-(iii) of Proposition 5.3 Le us first introduce a 
symbol a\(X2 ■ ■ ■ c*k to denote the string of length k in which no pair 00 appears. Then we define: 

• A is the set of all strings having the form 0:10:2 • • . o n +5. 
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• A\ is the set of all strings having the form a\a 2 ■ ■ ■ Qn+2ll0, 

• A 2 is the set of all strings having the form ot\u 2 . . . a n +i±101, 

• A3 is the set of all strings having the form aia 2 ■ ■ . a„11010, 

• A4 is the set of all strings having the form a\a 2 . . . a n 11011, 

• B is the set of all strings having the form 001aia2 . . . a n +2, 

• B\ is the set of all strings having the form 001aia 2 ■ ■ • a„_i±10, 

• B 2 is the set of all strings having the form 001aia2 . . . a„_2ll01. 



The set 51 of binary strings a\a 2 ■ ■ ■ a n +h satisfying conditions (i)-(iii) of Proposition 5.3 can be now 
written as 

n = A \ {Ax U A 2 U A3 U At) U B \ (B 1 U B 2 ). (25) 

Since A\ . . . A4 are mutually disjoint, and B\ and B 2 are disjoint too, the number elements in the set fl is 



card 51 = card A — card A\ — card A 2 — card A3 — card A4 

+ card B — card B\ — card B 2 , 



(26) 



which, using Lemma 6. 1 yields 



card 51 = F n+7 - {F n+i + F n+3 + F n+2 + F n+2 ) + F n+A - (F n+1 + F n ). (27) 

Using basic properies of Fibonacci numbers, the above simplifies to card 51 = 4F n +3. Now, since in the 



Proposition 5.3 the string a 



«n+5 



is preceded by n — 2 arbitrary symbols, we obtain 



cardf-"(lll) = 2"- 2 • 4F„ +3 = 2 n F n+3 , 
what was to be shown. 

7 Density of ones 

Using results of the previous section, eq. (TTTJ can now be rewritten as 

4 n-i + 2 n - 1 F n+1 + 2 n - 1 F n+2 



(28) 



which simplifies to 
or, more explicitly, to 



n— >oo ^n 



1 F n+3 

8 2"+ 2 ' 



1 (1 + \/5)"+ 3 - (1 - Vb) n + 3 
$ + ~ 2 2 "+ 5 75 

I , in agreement with the numerical value reported in 



(29) 



(30) 



(31) 



Wolfram 



(1994). We can 



Obviously, lim. 

see that c„ converges toward c^ exponentially fast, with some damped oscillations superimposed over 
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Fig. 3: Plot of the ratio — — as a function of time step n. Numerical results were obtained by iterating rule 

Cn Coo 

172 on a a configuration of length 10 8 with periodic boundary conditions. 



the exponential decay. This is illustrated in Figure [5] where, in order to emphasize the aforementioned 
oscillations, instead of c„ we plotted the ratio 



^n+l 



(32) 



as a function of n. One can show that d„ converges to the half of ratio divina (golden ratio), ip/2 sa 
0.809016 . . ., as illustrated in Figure [3] We can see from this figure that the convergence is very fast and 
that the agreement between numerical simulations and the theoretical formula is nearly perfect. 



8 Further results 



Results obtained in the previous two sections suffice to compute block probabilities for all blocks of 
length up to 3. Proposition |6.1| together with eq. ^ yields formulas for P n (001), P„(101), and P n (lll). 
Consistency conditions give P„(01) = P n (001) + P„(101). Furthermore P„(10) = P„(01) due to the 
fact that P„(10) + P n (00) = P n (01) + P n (00) = P„(0). Applying consistency conditions again we have 
P„(l) =P„(10)+P„(11), hence P„(ll) = P n (l)-P n (10), and, similarly, P n (00) = P„(0) -P„(10). 
This gives us probabilities of all blocks of length 2. Probabilities of blocks of length 3 can be obtained in 
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a similar fashion: 

P„(000) = P n (00) - P n (100), 
P„(110) = P n (ll) - Pn(Hl), 
P„(011) = P n (ll)-P„(lll), 
P n (010) = P n (01)-P re (011). 

The only missing probability, P n (100) is the same as P„(001) because P n (100) + P„(000) = P„(001) + 
P„(000) = P„(00). The following formulas summarize these results. 

P„(000) = 5/8 - 2-"- 2 F„ +3 - 2- n - A F n+2 , 

P„(001) = 1/8, 

P„(010) = l/8-2-"- 3 F„ +1 , 

Pn(Oll) = 2-"- 4 L„ +2 , 

Pn(100) = 1/8, 

■At. 

n+2, 

n+2, 

+3, 



P n (101) = 2-"- 4 F„ 
P n (110) - 2-"- 4 i, 



Pn(lll) = 2-"- 3 F„ 

where L n = 2F n+ i — F n is the n-th Lucas number. We can also rewrite these formulas in terms of 
cardinalities of preimage sets using eq. d8), as stated below. 

Theorem 8.1 Let f be the block evolution operator for CA rule 172. Then for any positive integer n we 
have 

cardf-"(000) = 5 • 4" - 2" +1 P„ +3 - 2"- 1 P„ +2 , 

card f~ n (001) = 4™, 

cardf-™(010) = 4"-2"F n+1 , 

cardf- n (011) = 2"- 1 L„ +2 , 

card f-"( 100) = 4™, 

cardf _n (101) = 2"- 1 F„ +2 , 

cardf-"(110) = 2 n ^L n+2 , 

cardf-"(lll) = 2"P n+3 , 



-0™ - (1 - V)" 

ci numuer, r n = 
number, L n = i\) n + (1 — tjj) 



iu — i j. — W I -i -I , — 

where F n is the n-th Fibonacci number, F n = = , ip = | + | v 5, and L n is the n-th Lucas 

V5 



9 Concluding remarks 



The method for computing block probabilities in cellular automata described in this paper is certainly 
not applicable to arbitrary CA rule. It will work only if the structure of level sets of preimage trees is 
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sufficiently regular so that the level sets can be enumerated by some known combinatorial technique. 
Altough "chaotic" rules like rule 18, or complex rules such as rule 110 certainly do not belong to this 
category, in surprisingly many cases significant regularities can be detected in preimage trees. Usually, this 
applies to "simple" rules, those which in Wolfram classification belong to class I, class II, and sometimes 
class III. Rule 172 reported here is one of the most interesting among such rules, primarily because the 
density of ones does not converge exponentially to some fixed value as in many other cases, but exhibits 
subtle damped oscillations on top of the exponential decay. Furthermore, the appearance of Fibonacci and 
Lucas numbers in formulas for block probabilities is rather surprising. 

One should add at this point that the convergence toward the steady state can be slower than exponential 



even in fairly "simple" cellular automata. Using similar method as in this paper, it has been found in|Fuks 



and Haroutunian (20091 that in rule 14 the density of ones converges toward its limit value approximately 



as a power law. The exact formula for the density of ones in rule 14 involves Catalan numbers, and the 
structure of level sets is quite different than the one reported here. Rule 142 exhibits somewhat similar 
behavior too, as reported in Fuks (2006). 



As a final remark, let us add that the results presented here assume initial measure //i/2- This can 
be generalized to arbitrary [i, v . In order to do this, one needs, instead of straightforward counting of 
preimages, to perform direct computation of their probabilities using methods based on Markov chain 
theory. Work on this problem is ongoing and will be reported elsewhere. 
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